Infrared camera systems and methods

ABSTRACT

Systems and methods disclosed herein provide, for some embodiments, infrared cameras and target position acquisition techniques for various applications. For example, in one embodiment, a system may include a portable imaging/viewing subsystem having a target position finder and may also include a fixed mount camera subsystem having a camera and a camera positioner. A communications link may be configured to communicate a signal from the target position finder to the camera positioner. The signal may be representative of a position of a target being imaged/viewed with the portable imaging/viewing subsystem. The camera positioner may aim the camera toward the target in response to the signal. The target may, for example, be a man overboard. Thus, the system may be useful in search and rescue operations.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of and claims priority to and thebenefit of U.S. patent application Ser. No. 13/443,794, filed Apr. 10,2012, which is incorporated herein by reference in its entirety.

U.S. patent application Ser. No. 13/443,794 is a continuation-in-partpatent application claiming priority to and the benefit of U.S. patentapplication Ser. No. 11/946,801, filed on Nov. 28, 2007, now U.S. Pat.No. 8,384,780, which is incorporated herein by reference in itsentirety.

U.S. patent application Ser. No. 13/443,794 claims priority to and thebenefit of U.S. Provisional Patent Application No. 61/474,209, filed onApr. 11, 2011, which is incorporated herein by reference in itsentirety.

TECHNICAL FIELD

The present disclosure relates to infrared imaging systems and, inparticular, to infrared camera systems and methods.

BACKGROUND

Infrared cameras are utilized in a variety of imaging applications tocapture infrared images. For example, infrared cameras may be utilizedfor maritime applications to enhance visibility under various conditionsfor a naval crew. However, there generally are a number of drawbacks forconventional maritime implementation approaches for infrared cameras.

One drawback of conventional infrared cameras is that a user isgenerally not allowed to switch between different processing techniquesduring viewing of the infrared image or the optimal settings may bedifficult to determine by the user. Another drawback is thatuser-controlled processing may occur post capture, after initialprocessing has been performed, which generally lessens the user's inputand control and may result in a less than desirable image beingdisplayed. Another drawback is that it may be difficult to aim a cameraat an object that is being viewed by a person using another camera(e.g., any type of portable viewing/imaging device, such as a pair ofbinoculars or a handheld camera).

As a result, there is a need for improved techniques for providingselectable viewing controls for infrared cameras. There is also a needfor improved infrared camera processing techniques for land and/ormaritime applications (e.g., for various types of watercraft, includinglarge vessels, such as cargo ships and cruise ships). There is also aneed for systems and methods that facilitate the aiming of a camera(e.g., a fixed mount camera) at an object within a field of view ofanother camera.

SUMMARY

Systems and methods disclosed herein, in accordance with one or moreembodiments, provide for the aiming of one or more cameras (e.g., fixedmount cameras) at an object that is being viewed/imaged by a personusing a portable viewing/imaging device or subsystem, such as a pair ofbinoculars, a night vision device, or a handheld camera. For example, inone embodiment, a more powerful, fixed mount night vision camera systemmay be aimed at a man overboard after the man overboard has been spottedwith a less powerful, handheld night vision device.

More specifically, in accordance with another embodiment of the presentdisclosure, a system includes a fixed mount camera subsystem having acamera, a camera positioner, and a first communications interface; and aportable imaging/viewing subsystem having a target position finder and asecond communications interface adapted to establish a communicationslink with the first communications interface to communicate a signalfrom the target position finder to the camera positioner, the signalbeing representative of position information of a target beingimaged/viewed with the portable imaging/viewing subsystem. The fixedmount camera subsystem may be configured to aim the camera using thecamera positioner toward the target in response to the signal.

In accordance with another embodiment of the present disclosure, aninfrared camera includes an image capture component adapted to capturean infrared image of a scene; a target position finder adapted to obtaintarget position information for a target within the scene; and acommunications interface configured to communicate a signal from theinfrared camera based on information from the target position finder,the signal being representative of position information for the targetbeing viewed with the infrared camera, wherein the communicationsinterface is further configured to receive target position informationfrom another device. The infrared camera may further include a controlcomponent adapted to provide selectable processing modes to a user,receive a user input corresponding to a user selected processing mode,and generate a control signal indicative of the user selected processingmode, wherein the selectable processing modes includes a processing oftarget position information received via the communications interfaceand a processing of the position information from the target positionfinder to provide via the communications interface; and a processingcomponent adapted to receive the generated control signal from thecontrol component and perform the selected processing function based onthe user selected processing mode.

In accordance with another embodiment of the present disclosure, amethod includes capturing an infrared image of a target within a fieldof view of a first infrared camera; determining position information ofthe target in response to a user command; storing the positioninformation of the target within the infrared camera; and communicatingwirelessly the position information of the target to a remote infraredcamera to assist the remote infrared camera in pointing to the target.

In accordance with an embodiment of the present disclosure, a system mayinclude a portable imaging/viewing subsystem having a target positionfinder and may also include a camera subsystem (e.g., fixed mount)having a camera and a camera positioner. A communications link may beconfigured to communicate a signal from the target position finder tothe camera positioner. The signal may be representative of a position ofa target being imaged/viewed by the portable imaging/viewing subsystem.The camera positioner may be configured to aim the camera toward thetarget in response to the signal.

In accordance with another embodiment of the present disclosure, ahandset may include a portable imaging/viewing subsystem having a targetposition finder. A communications link may be configured to communicatea signal from the target position finder. The signal may berepresentative of a position of a target being viewed by the portableimaging/viewing subsystem.

In accordance with another embodiment of the present disclosure, a fixedmount camera subsystem may include at least one camera, a camerapositioner, and a communications link configured to receive a signalrepresentative of a position of a target. The camera positioner may beconfigured to aim the camera toward the target in response to thesignal.

In accordance with another embodiment of the present disclosure, amethod may include imaging/viewing a target with a portableimaging/viewing subsystem, determining a position of the target with atarget position finder of the portable imaging/viewing subsystem, andcommunicating information representative of the position of the targetto a camera subsystem (e.g., a fixed mount camera subsystem). Forexample, a camera of the fixed mount camera subsystem may be aimedtoward the target in response to the signal.

The scope of the disclosure is defined by the claims, which areincorporated into this section by reference. A more completeunderstanding of embodiments of the present disclosure will be affordedto those skilled in the art, as well as a realization of additionaladvantages thereof, by a consideration of the following detaileddescription of one or more embodiments. Reference will be made to theappended sheets of drawings that will first be described briefly.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A-1B show block diagrams illustrating various infrared imagingsystems for capturing and processing infrared images in accordance withvarious embodiments of the present disclosure.

FIGS. 1C-1D show block diagrams illustrating various configurations forthe infrared imaging systems in accordance with various embodiments ofthe present disclosure.

FIGS. 1E-1F show block diagrams illustrating various views of theinfrared imaging systems in accordance with various embodiments of thepresent disclosure.

FIG. 2 shows a block diagram illustrating a method for capturing andprocessing infrared images in accordance with an embodiment of thepresent disclosure.

FIGS. 3A-3F show block diagrams illustrating infrared processingtechniques in accordance with various embodiments of the presentdisclosure.

FIG. 4 shows a block diagram illustrating an overview of infraredprocessing techniques in accordance with various embodiments of thepresent disclosure.

FIG. 5 shows a block diagram illustrating a control component of theinfrared imaging system for selecting between different modes ofoperation in accordance with an embodiment of the present disclosure.

FIG. 6 shows a block diagram illustrating an embodiment of an imagecapture component of infrared imaging systems in accordance with anembodiment of the present disclosure.

FIG. 7 shows a block diagram illustrating an embodiment of a method formonitoring image data of the infrared imaging systems in accordance withan embodiment of the present disclosure.

FIG. 8 shows a block diagram illustrating an imaging system for aiming acamera of a fixed mount camera subsystem at a target being observed witha portable imaging/viewing subsystem, in accordance with an embodimentof the present disclosure.

FIG. 9 shows a display that may be viewed by a user of the portableimaging/viewing subsystem, in accordance with an embodiment of thepresent disclosure.

FIG. 10 shows a block diagram illustrating the portable imaging/viewingsubsystem, in accordance with an embodiment of the present disclosure.

FIG. 11 shows a block diagram illustrating the fixed mount camerasubsystem, in accordance with an embodiment of the present disclosure.

FIG. 12 shows a flow chart illustrating a method for aiming the cameraof the fixed mount camera subsystem at the target using the portableimaging/viewing subsystem, in accordance with an embodiment of thepresent disclosure.

FIG. 13 shows a flow chart illustrating a method for determining aposition of the target with respect to the portable imaging/viewingsubsystem, in accordance with an embodiment of the present disclosure.

Embodiments of the present disclosure and their advantages are bestunderstood by referring to the detailed description that follows. Itshould be appreciated that like reference numerals are used to identifylike elements illustrated in one or more of the figures.

DETAILED DESCRIPTION

In accordance with an embodiment of the present disclosure, FIG. 1Ashows a block diagram illustrating an infrared imaging system 100A forcapturing and processing infrared images. Infrared imaging system 100Acomprises a processing component 110, a memory component 120, an imagecapture component 130, a display component 140, a control component 150,and optionally a sensing component 160.

In various implementations, infrared imaging system 100A may representan infrared imaging device, such as an infrared camera, to captureimages, such as image 170. Infrared imaging system 100A may representany type of infrared camera, which for example detects infraredradiation and provides representative data (e.g., one or more snapshotsor video infrared images). For example, infrared imaging system 100A mayrepresent an infrared camera that is directed to the near, middle,and/or far infrared spectrums. Infrared imaging system 100A may comprisea portable device and may be incorporated, for example, into a vehicle(e.g., a naval vehicle, a land-based vehicle, an aircraft, or aspacecraft) or a non-mobile installation requiring infrared images to bestored and/or displayed.

Processing component 110 comprises, in one embodiment, a microprocessor,a single-core processor, a multi-core processor, a microcontroller, alogic device (e.g., a programmable logic device configured to performprocessing functions), a digital signal processing (DSP) device, or someother type of generally known processor. Processing component 110 isadapted to interface and communicate with components 120, 130, 140, 150and 160 to perform method and processing steps as described herein.Processing component 110 may comprise one or more mode modules 112A-112Nfor operating in one or more modes of operation, which is described ingreater detail herein. In one implementation, mode modules 112A-112Ndefine preset display functions that may be embedded in processingcomponent 110 or stored on memory component 120 for access and executionby processing component 110. Moreover, processing component 110 may beadapted to perform various other types of image processing algorithms ina manner as described herein.

In various implementations, it should be appreciated that each of modemodules 112A-112N (where “N” represents any number) may be integrated insoftware and/or hardware as part of processing component 110, or code(e.g., software or configuration data) for each of the modes ofoperation associated with each mode module 112A-112N, which may bestored in memory component 120. Embodiments of mode modules 112A-112N(i.e., modes of operation) disclosed herein may be stored by a separatecomputer-readable medium (e.g., a memory, such as a hard drive, acompact disk, a digital video disk, or a flash memory) to be executed bya computer (e.g., a logic or processor-based system) to perform variousmethods disclosed herein. In one example, the computer-readable mediummay be portable and/or located separate from infrared imaging system100A, with stored mode modules 112A-112N provided to infrared imagingsystem 100A by coupling the computer-readable medium to infrared imagingsystem 100A and/or by infrared imaging system 100A downloading (e.g.,via a wired or wireless link) the mode modules 112A-112N from thecomputer-readable medium. As described in greater detail herein, modemodules 112A-112N provide for improved infrared camera processingtechniques for real time applications, wherein a user or operator maychange the mode while viewing an image on display component 140 and/orperform one or more methods.

Memory component 120 comprises, in one embodiment, one or more memorydevices to store data and information. The one or more memory devicesmay comprise various types of memory including volatile and non-volatilememory devices, such as RAM (Random Access Memory), ROM (Read-OnlyMemory), EEPROM (Electrically-Erasable Read-Only Memory), flash memory,etc. Processing component 110 is adapted to execute software stored inmemory component 120 to perform methods, processes, and modes ofoperations in manner as described herein.

Image capture component 130 comprises, in one embodiment, one or moreinfrared sensors (e.g., any type of infrared detector, such as a focalplane array) for capturing infrared image signals representative of animage, such as image 170. In one implementation, the infrared sensors ofimage capture component 130 provide for representing (e.g., converting)a captured image signal of image 170 as digital data (e.g., via ananalog-to-digital converter included as part of the infrared sensor orseparate from the infrared sensor as part of infrared imaging system100A). Processing component 110 may be adapted to receive the infraredimage signals from image capture component 130, process the infraredimage signals (e.g., to provide processed image data), store theinfrared image signals or image data in memory component 120, and/orretrieve stored infrared image signals from memory component 120.Processing component 110 may be adapted to process infrared imagesignals stored in memory component 120 to provide image data (e.g.,captured and/or processed infrared image data) to display component 140for viewing by a user.

Display component 140 comprises, in one embodiment, an image displaydevice (e.g., a liquid crystal display (LCD)) or various other types ofgenerally known video displays or monitors. Processing component 110 maybe adapted to display image data and information on display component140. Processing component 110 may also be adapted to retrieve image dataand information from memory component 120 and display any retrievedimage data and information on display component 140. Display component140 may comprise display electronics, which may be utilized byprocessing component 110 to display image data and information (e.g.,infrared images). Display component 140 may receive image data andinformation directly from image capture component 130 via processingcomponent 110, or the image data and information may be transferred frommemory component 120 via processing component 110. In oneimplementation, processing component 110 may initially process acaptured image and present a processed image in one mode, correspondingto mode modules 112A-112N, and then upon user input to control component150, processing component 110 may switch the current mode to a differentmode for viewing the processed image on display component 140 in thedifferent mode. This switching may be referred to as applying theinfrared camera processing techniques of mode modules 112A-112N for realtime applications, wherein a user or operator may change the mode whileviewing an image on display component 140 based on user input to controlcomponent 150.

Control component 150 comprises, in one embodiment, a user input and/orinterface device having one or more user actuated components, such asone or more push buttons, slide bars, rotatable knobs or a keyboard,that are adapted to generate one or more user actuated input controlsignals. Control component 150 may be adapted to be integrated as partof display component 140 to function as both a user input device and adisplay device, such as, for example, a touch screen device adapted toreceive input signals from a user touching different parts of thedisplay screen. Processing component 110 may be adapted to sense controlinput signals from control component 150 and respond to any sensedcontrol input signals received therefrom. Processing component 110 maybe adapted to interpret the control input signal as a value, which willbe described in greater detail herein.

Control component 150 may comprise, in one embodiment, a control panelunit 500 (e.g., a wired or wireless handheld control unit) having one ormore push buttons adapted to interface with a user and receive userinput control values, as shown in FIG. 5 and further described herein.In various implementations, one or more push buttons of control panelunit 500 may be utilized to select between the various modes ofoperation as described herein in reference to FIGS. 2-4. For example,only one push button may be implemented and which is used by theoperator to cycle through the various modes of operation (e.g., nightdocking, man overboard, night cruising, day cruising, hazy conditions,and shoreline), with the selected mode indicated on the displaycomponent 140. In various other implementations, it should beappreciated that control panel unit 500 may be adapted to include one ormore other push buttons to provide various other control functions ofinfrared imaging system 100A, such as auto-focus, menu enable andselection, field of view (FoV), brightness, contrast, gain, offset,spatial, temporal, and/or various other features and/or parameters. Inanother implementation, a variable gain value may be adjusted by theuser or operator based on a selected mode of operation.

In another embodiment, control component 150 may comprise a graphicaluser interface (GUI), which may be integrated as part of displaycomponent 140 (e.g., a user actuated touch screen), having one or moreimages of, for example, push buttons adapted to interface with a userand receive user input control values.

Optional sensing component 160 comprises, in one embodiment, one or morevarious types of sensors, including environmental sensors, dependingupon the desired application or implementation requirements, whichprovide information to processing component 110. Processing component110 may be adapted to communicate with sensing component 160 (e.g., byreceiving sensor information from sensing component 160) and with imagecapture component 130 (e.g., by receiving data from image capturecomponent 130 and providing and/or receiving command, control or otherinformation to and/or from other components of infrared imaging system100A).

In various implementations, optional sensing component 160 may providedata and information relating to environmental conditions, such asoutside temperature, lighting conditions (e.g., day, night, dusk, and/ordawn), humidity level, specific weather conditions (e.g., sun, rain,and/or snow), distance (e.g., laser rangefinder), and/or whether atunnel, a covered dock, or that some type of enclosure has been enteredor exited. Optional sensing component 160 may represent conventionalsensors as would be known by one skilled in the art for monitoringvarious conditions (e.g., environmental conditions) that may have anaffect (e.g., on the image appearance) on the data provided by imagecapture component 130.

In some embodiments, optional sensing component 160 (e.g., one or moreof sensors 106) may comprise devices that relay information toprocessing component 110 via wireless communication. For example,sensing component 160 may be adapted to receive information from asatellite, through a local broadcast (e.g., radio frequency)transmission, through a mobile or cellular network and/or throughinformation beacons in an infrastructure (e.g., a transportation orhighway information beacon infrastructure) or various other wired orwireless techniques.

In various embodiments, components of image capturing system 100A may becombined and/or implemented or not, as desired or depending upon theapplication or requirements, with image capturing system 100Arepresenting various functional blocks of a system (e.g., a portablecamera or a distributed network system). For example, processingcomponent 110 may be combined with memory component 120, image capturecomponent 130, display component 140 and/or sensing component 160. Inanother example, processing component 110 may be combined with imagecapture component 130 with only certain functions of processingcomponent 110 performed by circuitry (e.g., a processor, amicroprocessor, a microcontroller, a logic device, etc.) within imagecapture component 130, while other processing functions are performed ona separate device (e.g., a computer on a network in communication withprocessing component 110). In still another example, control component150 may be combined with one or more other components or be remotelyconnected to at least one other component, such as processing component110, via a control wire or a network (e.g., a wireless or wired networklink) so as to provide control signals thereto.

In accordance with another embodiment of the present disclosure, FIG. 1Bshows a block diagram illustrating an infrared imaging system 100B forcapturing and processing infrared images. Infrared imaging system 100Bcomprises, in one embodiment, a processing component 110, an interfacecomponent 118, a memory component 120, one or more image capturecomponents 130A-130N, a display component 140, a control component 150,and optionally a sensing component 160. It should be appreciated thatvarious components of infrared imaging system 100B of FIG. 1B may besimilar in function and scope to components of infrared imaging system100A of FIG. 1A, and any differences between the systems 100A, 100B aredescribed in greater detail herein.

In various implementations, infrared imaging system 100B may representone or more infrared imaging devices, such as one or more infraredcameras, to capture images, such as images 170A-170N. In general,infrared imaging system 100B may utilize a plurality of infraredcameras, which for example detect infrared radiation and providerepresentative data (e.g., one or more snapshots or video infraredimages). For example, infrared imaging system 100B may include one ormore infrared cameras that are directed to the near, middle, and/or farinfrared spectrums. As discussed further herein, infrared imaging system100B may be incorporated, for example, into a vehicle (e.g., a navalvehicle or other type of watercraft, a land-based vehicle, an aircraft,or a spacecraft) or a non-mobile installation requiring infrared imagesto be stored and/or displayed.

Processing component 110 is adapted to interface and communicate with aplurality of components including components 118, 120, 130A-130N, 140,150, and/or 160 of system 100B to perform method and processing steps asdescribed herein. Processing component 110 may comprise one or more modemodules 112A-112N for operating in one or more modes of operation, whichis described in greater detail herein. Processing component 110 may beadapted to perform various other types of image processing algorithms ina manner as described herein.

Interface component 118 comprises, in one embodiment, a communicationdevice (e.g., modem, router, switch, hub, or Ethernet card) that allowscommunication between each image capture component 130A-130N andprocessing component 110. As such, processing component 110 is adaptedto receive infrared image signals from each image capture component130A-130N via interface component 118.

Each image capture component 130A-130N (where “N” represents any desirednumber) comprises, in various embodiments, one or more infrared sensors(e.g., any type of infrared detector, such as a focal plane array, orany type of infrared camera, such as infrared imaging system 100A) forcapturing infrared image signals representative of an image, such as oneor more images 170A-170N. In one implementation, the infrared sensors ofimage capture component 130A provide for representing (e.g., converting)a captured image signal of, for example, image 170A as digital data(e.g., via an analog-to-digital converter included as part of theinfrared sensor or separate from the infrared sensor as part of infraredimaging system 100B). As such, processing component 110 may be adaptedto receive the infrared image signals from each image capture component130A-130N via interface component 118, process the infrared imagesignals (e.g., to provide processed image data or the processed imagedata may be provided by each image capture component 130A-130N), storethe infrared image signals or image data in memory component 120, and/orretrieve stored infrared image signals from memory component 120.Processing component 110 may be adapted to process infrared imagesignals stored in memory component 120 to provide image data (e.g.,captured and/or processed infrared image data) to display component 140(e.g., one or more displays) for viewing by a user.

In one implementation as an example, referring briefly to FIG. 6, eachimage capture component 130A-130N may comprise one or more components,including a first camera component 132, a second camera component 134,and/or a searchlight component 136. In one embodiment as shown in FIG.6, first camera component 132 is adapted to capture infrared images in amanner as described herein, second camera component 134 is adapted tocapture color images in a visible light spectrum, and searchlightcomponent 136 is adapted to provide a beam of light to a position withinan image boundary of the one or more images 170 (e.g., within a field ofview of first camera component 132 and/or second camera component 134).Further scope and function related to each of these components isdescribed in greater detail herein.

FIG. 1C shows a top-view of infrared imaging system 100B having aplurality of image capture components 130A-130D (e.g., infrared cameras)mounted to a watercraft 180 in accordance with an embodiment of thepresent disclosure. In various implementations, image capture components130A-130D may comprise any type of infrared camera (e.g., infrareddetector device) adapted to capture one or more infrared images.Watercraft 180 may represent any type of watercraft (e.g., a boat,yacht, ship, cruise ship, tanker, commercial vessel, military vessel,etc.).

As shown in FIG. 1C, a plurality of image capture components 130A-130Dmay be mounted in a configuration at different positions on watercraft180 in a manner so as to provide one or more fields of view aroundwatercraft 180. In various implementations, an image capture component130A may be mounted to provide a field of view ahead of or around a bow182 (e.g., forward or fore part) of watercraft 180. As further shown, animage capture component 130B may be mounted to provide a field of viewto the side of or around a port 184 (e.g., left side when facing bow182) of watercraft 180. As further shown, an image capture component130C may be mounted to provide a field of view to the side of or arounda starboard 186 (e.g., right side when facing bow 182) of watercraft180. As further shown, an image capture component 130D may be mounted toprovide a field of view behind of or around a stern 188 (e.g., rear oraft part) of watercraft 180.

Thus, in one implementation, a plurality of infrared capture components130A-130D (e.g., infrared cameras) may be mounted around the perimeterof watercraft 180 to provide fields of view thereabout. As an exampleand as discussed further herein, watercraft 180 may incorporate infraredimaging system 100B to provide man overboard detection, to assist duringvarious modes of operation, such as night docking, night cruising,and/or day cruising of watercraft 180, and/or to provide variousinformation, such as improved image clarity during hazy conditions or toprovide a visual indication of the horizon and/or shoreline.

FIG. 1D shows a top-view of infrared imaging system 100B having aplurality of image capture components 130E-130H (e.g., infrared cameras)mounted to a control tower 190 (e.g., bridge) of watercraft 180 inaccordance with an embodiment of the present disclosure. As shown inFIG. 1D, a plurality of image capture components 130E-130H may bemounted to control tower 190 in a configuration at different positionson watercraft 180 in a manner so as to provide one or more fields ofview around watercraft 180. In various implementations, image capturecomponent 130E may be mounted to provide a field of view of bow 182 ofwatercraft 180. As further shown, image capture component 130F may bemounted to provide a field of view of port 184 of watercraft 180. Asfurther shown, image capture component 130G may be mounted to provide afield of view of starboard 186 of watercraft 180. As further shown,image capture component 130H may be mounted to provide a field of viewof stern 188 of watercraft 180. Thus, in one implementation, a pluralityof image capture components 130E-130H (e.g., infrared cameras) may bemounted around control tower 190 of watercraft 180 to provide fields ofview thereabout. Furthermore as shown, image capture components 130B and130C may also be mounted on control tower 190 of watercraft 180.

FIG. 1E shows the port-side-view of infrared imaging system 100B havingport-side image capture component 130B of FIG. 1B mounted to watercraft180 in accordance with an embodiment of the present disclosure. Inreference to FIG. 1E, image capture component 130B provides a port-sidefield of view around watercraft 180.

In one implementation, image capture component 130B may provide a fieldof view of a port-side image of watercraft 180. In anotherimplementation, the port-side field of view may be segmented into aplurality of views B1-B6. For example, image capture component 130B maybe adapted to provide one or more segmented narrow fields of view of theport-side field of view including one or more forward port-side viewsB1-B3 and one or more rearward port-side views B4-B6. In still anotherimplementation, as shown in FIG. 6, image capture component 130B maycomprise a plurality of image capture components 132 (and optionally aplurality of image capture components 134) to provide the plurality ofsegmented or narrowed fields of view B1-B6 within the overall port-sidefield of view of watercraft 180.

As further shown in FIG. 1E, the port-side fields of view B1-B6 ofwatercraft 180 may extend through a viewing range from image capturecomponent 130B to a water surface 198 adjacent to watercraft 180.However, in various implementations, the viewing range may include aportion below the water surface 198 depending on the type of infrareddetector utilized (e.g., type of infrared camera, desired wavelength orportion of the infrared spectrum, and other relevant factors as would beunderstood by one skilled in the art).

FIG. 1F shows an example of locating and identifying a man overboardwithin the port-side field of view of port-side image capture component130B mounted to watercraft 180 in accordance with an embodiment of thepresent disclosure. In general, image capture component 130B may be usedto identify and locate a man overboard (e.g., within the narrowedport-side field of view B3) of watercraft 180. Once the man overboard isidentified and located, processing component 110 of infrared imagingsystem 100B may control or provide information (e.g., slew-to-queue) toposition searchlight component 136 within the port-side field of view B3to aid in visual identification and rescue of the man overboard. Itshould be understood that searchlight component 136 may be separate fromimage capture component 130B (e.g., separate housing and/or control) ormay be formed as part of image capture component 130B (e.g., within thesame housing or enclosure). Further scope and function related to thisprocedure is described in greater detail herein.

FIG. 2 shows a method 200 for capturing and processing infrared imagesin accordance with an embodiment of the present disclosure. For purposesof simplifying discussion of FIG. 2, reference may be made to imagecapturing systems 100A, 100B of FIGS. 1A, 1B as an example of a system,device or apparatus that may perform method 200.

Referring to FIG. 2, an image (e.g., infrared image signal) is captured(block 210) with infrared imaging system 100A, 100B. In oneimplementation, processing component 110 induces (e.g., causes) imagecapture component 130 to capture an image, such as, for example, image170. After receiving the captured image from image capture component130, processing component 110 may optionally store the captured image inmemory component 120 for processing.

Next, the captured image may optionally be pre-processed (block 215). Inone implementation, pre-processing may include obtaining infrared sensordata related to the captured image, applying correction terms, and/orapplying temporal noise reduction to improve image quality prior tofurther processing. In another implementation, processing component 110may directly pre-process the captured image or optionally retrieve thecaptured image stored in memory component 120 and then pre-process theimage. Pre-processed images may be optionally stored in memory component120 for further processing.

Next, a selected mode of operation may be obtained (block 220). In oneimplementation, the selected mode of operation may comprise a user inputcontrol signal that may be obtained or received from control component150 (e.g., control panel unit 500 of FIG. 5). In variousimplementations, the selected mode of operation may be selected from atleast one of night docking, man overboard, night cruising, day cruising,hazy conditions, and shoreline mode. As such, processing component 110may communicate with control component 150 to obtain the selected modeof operation as input by a user. These modes of operation are describedin greater detail herein and may include the use of one or more infraredimage processing algorithms.

In various implementations, modes of operation refer to presetprocessing and display functions for an infrared image, and infraredimagers and infrared cameras are adapted to process infrared sensor dataprior to displaying the data to a user. In general, display algorithmsattempt to present the scene (i.e., field of view) information in aneffective way to the user. In some cases, infrared image processingalgorithms are utilized to present a good image under a variety ofconditions, and the infrared image processing algorithms provide theuser with one or more options to tune parameters and run the camera in“manual mode”. In one aspect, infrared imaging system 100A, 100B may besimplified by hiding advanced manual settings. In another aspect, theconcept of preset image processing for different conditions may beimplemented in maritime applications.

Next, referring to FIG. 2, the image is processed in accordance with theselected mode of operation (block 225), in a manner as described ingreater detail herein. In one implementation, processing component 110may store the processed image in memory component 120 for displaying. Inanother implementation, processing component 110 may retrieve theprocessed image stored in memory component 120 and display the processedimage on display component 140 for viewing by a user.

Next, a determination is made as to whether to display the processedimage in a night mode (block 230), in a manner as described in greaterdetail herein. If yes, then processing component 110 configures displaycomponent 140 to apply a night color palette to the processed image(block 235), and the processed image is displayed in night mode (block240). For example, in night mode (e.g., for night docking, nightcruising, or other modes when operating at night), an image may bedisplayed in a red palette or green palette to improve night visioncapacity for a user. Otherwise, if night mode is not necessary, then theprocessed image is displayed in a non-night mode manner (e.g., black hotor white hot palette) (block 240).

In various implementations, the night mode of displaying images refersto using a red color palette or green color palette to assist the useror operator in the dark when adjusting to low light conditions. Duringnight operation of image capturing system 100A, 100B, human visualcapacity to see in the dark may be impaired by the blinding effect of abright image on a display monitor. Hence, the night mode setting changesthe color palette from a standard black hot or white hot palette to ared or green color palette display. In one aspect, the red or greencolor palette is generally known to interfere less with human nightvision capacity. In one example, for a red-green-blue (RGB) type ofdisplay, the green and blue pixels may be disabled to boost the redcolor for a red color palette. In another implementation, the night modedisplay may be combined with any other mode of operation of infraredimaging system 100A, 100B, as described herein, and a default displaymode of infrared imaging system 100A, 100B at night may be the nightmode display.

Furthermore in various implementations, certain image features may beappropriately marked (e.g., color-indicated or colorized, highlighted,or identified with other indicia), such as during the image processing(block 225) or displaying of the processed image (block 240), to aid auser to identify these features while viewing the displayed image. Forexample, as discussed further herein, during a man overboard mode, asuspected person (e.g., or other warm-bodied animal or object) may beindicated in the displayed image with a blue color (or other color ortype of marking) relative to the black and white palette or night colorpalette (e.g., red palette). As another example, as discussed furtherherein, during a night time or daytime cruising mode and/or hazyconditions mode, potential hazards in the water may be indicated in thedisplayed image with a yellow color (or other color or type of marking)to aid a user viewing the display. Further details regarding imagecolorization may be found, for example, in U.S. Pat. No. 6,849,849,which is incorporated herein by reference in its entirety.

In various implementations, processing component 110 may switch theprocessing mode of a captured image in real time and change thedisplayed processed image from one mode, corresponding to mode modules112A-112N, to a different mode upon receiving user input from controlcomponent 150. As such, processing component 110 may switch a currentmode of display to a different mode of display for viewing the processedimage by the user or operator on display component 140. This switchingmay be referred to as applying the infrared camera processing techniquesof mode modules 112A-112N for real time applications, wherein a user oroperator may change the displayed mode while viewing an image on displaycomponent 140 based on user input to control component 150.

FIGS. 3A-3E show block diagrams illustrating infrared processingtechniques in accordance with various embodiments of the presentdisclosure. As described herein, infrared imaging system 100A, 100B isadapted to switch between different modes of operation so as to improvethe infrared images and information provided to a user or operator.

FIG. 3A shows one embodiment of an infrared processing technique 300 asdescribed in reference to block 225 of FIG. 2. In one implementation,the infrared processing technique 300 comprises a night docking mode ofoperation for maritime applications. For example, during night docking,a watercraft or sea vessel is in the vicinity of a harbor, jetty ormarina, which have proximate structures including piers, buoys, otherwatercraft, other structures on land. A thermal infrared imager (e.g.,infrared imaging system 100A, 100B) may be used as a navigational toolin finding a correct docking spot. The infrared imaging system 100A,100B produces an infrared image that assists the user or operator indocking the watercraft. There is a high likelihood of hotspots in theimage, such as dock lights, vents and running motors, which may have aminimal impact on how the scene is displayed.

Referring to FIG. 3A, the input image is histogram equalized and scaled(e.g., 0-511) to form a histogram equalized part (block 302). Next, theinput image is linearly scaled (e.g., 0-128) while saturating thehighest and lowest (e.g., 1%) to form a linearly scaled part (block304). Next, the histogram-equalized part and the linearly scaled partare added together to form an output image (block 306). Next, thedynamic range of the output image is linearly mapped to fit the displaycomponent 140 (block 308). It should be appreciated that the block orderin which the process 300 is executed may be executed in an differentorder without departing from the scope of the present disclosure.

In one embodiment, the night docking mode is intended for image settingswith large amounts of thermal clutter, such as a harbor, a port, or ananchorage. The settings may allow the user to view the scene withoutblooming on hot objects. Hence, infrared processing technique 300 forthe night docking mode is useful for situational awareness in maritimeapplications when, for example, docking a watercraft with lowvisibility.

In various implementations, during processing of an image when the nightdocking mode is selected, the image is histogram equalized to compressthe dynamic range by removing “holes” in the histogram. The histogrammay be plateau limited so that large uniform areas, such as sky or watercomponents, are not given too much contrast. For example, approximately20% of the dynamic range of the output image may be preserved for astraight linear mapping of the non-histogram equalized image. In thelinear mapping, for example, the lowest 1% of the pixel values aremapped to zero and the highest 1% of the input pixels are mapped to amaximum value of the display range (e.g., 235). In one aspect, the finaloutput image becomes a weighted sum of the histogram equalized andlinearly (with 1% “outlier” cropping) mapped images.

FIG. 3B shows one embodiment of an infrared processing technique 320 asdescribed in reference to block 225 of FIG. 2. In one implementation,the infrared processing technique 320 comprises a man overboard mode ofoperation for maritime applications. For example, in the man overboardmode, image capturing system 100A, 100B may be tuned to the specifictask of finding a person in the water. The distance between the personin the water and the watercraft may not be known, and the person may beonly a few pixels in diameter or significantly larger if lying close tothe watercraft. In one aspect, even if a person may be close to thewatercraft, the person may have enough thermal signature to be clearlyvisible, and thus the man overboard display mode may target the casewhere the person has weak thermal contrast and is far enough away so asto not be clearly visible without the aid of image capturing system100A, 100B.

Referring to FIG. 3B, image capture component 130 (e.g., infraredcamera) of image capturing system 100A, 100B is positioned to resolve oridentify the horizon (block 322). In one implementation, the infraredcamera is moved so that the horizon is at an upper part of the field ofview (FoV). In another implementation, the shoreline may also beindicated along with the horizon. Next, a high pass filter (HPF) isapplied to the image to form an output image (block 324). Next, thedynamic range of the output image is linearly mapped to fit the displaycomponent 140 (block 326). It should be appreciated that the block orderin which the process 320 is executed may be executed in an differentorder without departing from the scope of the present disclosure.

In one example, horizon identification may include shorelineidentification, and the horizon and/or shoreline may be indicated by aline (e.g., a red line or other indicia) superimposed on a thermal imagealong the horizon and/or the shoreline, which may be useful for user oroperators to determine position of the watercraft in relation to theshoreline. Horizon and/or shoreline identification may be accomplishedby utilizing a real-time Hough transform or other equivalent type oftransform applied to the image stream, wherein this image processingtransform finds linear regions (e.g., lines) in an image. The real-timeHough transform may also be used to find the horizon and/or shoreline inopen ocean when, for example, the contrast may be low. Under clearconditions, the horizon and/or shoreline may be easy identified.However, on a hazy day, the horizon and/or shoreline may be difficult tolocate.

In general, knowing where the horizon and/or shoreline are is useful forsituational awareness. As such, in various implementations, the Houghtransform may be allied to any of the modes of operation describedherein to identify the horizon and/or shoreline in an image. Forexample, the shoreline identification (e.g., horizon and/or shoreline)may be included along with any of the processing modes to provide a line(e.g., any type of marker, such as a red line or other indicia) on thedisplayed image and/or the information may be used to position theinfrared camera's field of view.

In one embodiment of the man overboard mode, signal gain may beincreased to bring out minute temperature differences of the ocean, suchas encountered when looking for a hypothermic body in a uniform oceantemperature that may be close to the person's body temperature. Imagequality is traded for the ability to detect small temperature changeswhen comparing a human body to ocean temperature. Thus, infraredprocessing technique 320 for the man overboard mode is useful forsituational awareness in maritime applications when, for example,searching for a man overboard proximate to the watercraft.

In various implementations, during processing of an image when the manoverboard mode is selected, a high pass filter is applied to the image.For example, the signal from the convolution of the image by a Gaussiankernel may be subtracted. The remaining high pass information islinearly stretched to fit the display range, which may increase thecontrast of any small object in the water. In one enhancement of the manoverboard mode, objects in the water may be marked, and the systemsignals the watercraft to direct a searchlight at the object. Forsystems with both visible and thermal imagers, the thermal imager isdisplayed. For zoom or multi-FoV systems, the system is set in a wideFoV. For pan-tilt controlled systems with stored elevation settings forthe horizon, the system is moved so that the horizon is visible justbelow the upper limit of the field of view.

In one embodiment, the man overboard mode may activate a locateprocedure to identify an area of interest, zoom-in on the area ofinterest, and position a searchlight on the area of interest. Forexample, the man overboard mode may activate a locate procedure toidentify a position of a object (e.g., a person) in the water, zoom-inthe infrared imaging device (e.g., an infrared camera) on the identifiedobject in the water, and then point a searchlight on the identifiedobject in the water. In various implementations, these actions may beadded to process 200 of FIG. 2 and/or process 320 of FIG. 3B and furtherbe adapted to occur automatically so that the area of interest and/orlocation of the object of interest may be quickly identified andretrieved by a crew member.

FIG. 3C shows one embodiment of an infrared processing technique 340 asdescribed in reference to block 225 of FIG. 2. In one implementation,the infrared processing technique 340 comprises a night cruising mode ofoperation for maritime applications. For example, during night cruising,the visible channel has limited use for other than artificiallyilluminated objects, such as other watercraft. The thermal infraredimager may be used to penetrate the darkness and assist in theidentification of buoys, rocks, other watercraft, islands and structureson shore. The thermal infrared imager may also find semi-submergedobstacles that potentially lie directly in the course of the watercraft.In the night cruising mode, the display algorithm may be tuned to findobjects in the water without distorting the scene (i.e., field of view)to the extent that it becomes useless for navigation.

In one embodiment, the night cruising mode is intended for low contrastsituations encountered on an open ocean. The scene (i.e., field of view)may be filled with a uniform temperature ocean, and any navigationalaids or floating debris may sharply contrast with the uniformtemperature of the ocean. Therefore, infrared processing technique 340for the night cruising mode is useful for situational awareness in, forexample, open ocean.

Referring to FIG. 3C, the image is separated into a background imagepart and a detailed image part (block 342). Next, the background imagepart is histogram equalized (block 344) and scaled (e.g., 0-450) (block346). Next, the detailed image part is scaled (e.g., 0-511) (block 348).Next, the histogram-equalized background image part and the scaleddetailed image part are added together to form an output image (block350). Next, the dynamic range of the output image is linearly mapped tofit the display component 140 (block 352). It should be appreciated thatthe block order in which the process 340 is executed may be executed inan different order without departing from the scope of the presentdisclosure.

In various implementations, during processing of an image when the nightcruising mode is selected, the input image is split into detailed andbackground image components using a non-linear edge preserving low passfilter (LPF), such as a median filter or by anisotropic diffusion. Thebackground image component comprises a low pass component, and thedetailed image part is extracted by subtracting the background imagepart from the input image. To enhance the contrast of small andpotentially weak objects, the detailed and background image componentsmay be scaled so that the details are given approximately 60% of theoutput/display dynamic range. In one enhancement of the night cruisingmode, objects in the water are tracked, and if they are on directcollision course as the current watercraft course, then they are markedin the image, and an audible and/or visual alarm may be sounded and/ordisplayed, respectively. In some implementations, for systems with bothvisible and thermal imager, the thermal imager may be displayed bydefault.

In one embodiment, a first part of the image signal may include abackground image part comprising a low spatial frequency high amplitudeportion of an image. In one example, a low pass filter (e.g., low passfilter algorithm) may be utilized to isolate the low spatial frequencyhigh amplitude portion of the image signal (e.g., infrared imagesignal). In another embodiment, a second part of the image signal mayinclude a detailed image part comprising a high spatial frequency lowamplitude portion of an image. In one example, a high pass filter (e.g.,high pass filter algorithm) may be utilized to isolate the high spatialfrequency low amplitude portion of the image signal (e.g., infraredimage signal). Alternately, the second part may be derived from theimage signal and the first part of the image signal, such as bysubtracting the first part from the image signal.

In general for example, the two image parts (e.g., first and secondparts) of the image signal may be separately scaled before merging thetwo image parts to produce an output image. For example, the first orsecond parts may be scaled or both the first and second parts may bescaled. In one aspect, this may allow the system to output an imagewhere fine details are visible and tunable even in a high dynamic rangescene. In some instances, as an example, if an image appears less usefulor degraded by some degree due to noise, then one of the parts of theimage, such as the detailed part, may be suppressed rather thanamplified to suppress the noise in the merged image to improve imagequality.

FIG. 3D shows one embodiment of an infrared processing technique 360 asdescribed in reference to block 225 of FIG. 2. In one implementation,the infrared processing technique 360 comprises a day cruising mode ofoperation for maritime applications. For example, during day cruising,the user or operator may rely on human vision for orientationimmediately around the watercraft. Image capturing system 100A, 100B maybe used to zoom in on objects of interest, which may involve reading thenames of other watercraft, and searching for buoys, structures on land,etc.

Referring to FIG. 3D, the image is separated into a background imagepart and a detailed image part (block 362). Next, the background imagepart is histogram equalized (block 364) and scaled (e.g., 0-511) (block366). Next, the detailed image part is scaled 0-255 (block 368). Next,the histogram-equalized background image part and the scaled detailedimage part are added together to form an output image (block 370). Next,the dynamic range of the output image is linearly mapped to fit thedisplay component 140 (block 372). It should be appreciated that theblock order in which the process 360 is executed may be executed in andifferent order without departing from the scope of the presentdisclosure.

In one embodiment, the day cruising mode is intended for higher contrastsituations, such as when solar heating leads to greater temperaturedifferences between unsubmerged or partially submerged objects and theocean temperature. Hence, infrared processing technique 360 for the daycruising mode is useful for situational awareness in, for example, highcontrast situations in maritime applications.

In various implementations, during processing of an image when the daycruising mode is selected, the input image is split into its detailedand background components respectively using a non-linear edgepreserving low pass filter, such as a median filter or by anisotropicdiffusion. For color images, this operation may be achieved on theintensity part of the image (e.g., Y in a YCrCb format). The backgroundimage part comprises the low pass component, and the detailed image partmay be extracted by subtracting the background image part from the inputimage. To enhance the contrast of small and potentially weak objects,the detailed and background image parts may be scaled so that thedetails are given approximately 35% of the output/display dynamic range.For systems with both visible and thermal imagers the visible image maybe displayed by default.

FIG. 3E shows one embodiment of an infrared processing technique 380 asdescribed in reference to block 225 of FIG. 2. In one implementation,the infrared processing technique 380 comprises a hazy conditions modeof operation for maritime applications. For example, even during daytimeoperation, a user or operator may achieve better performance from animager using an infrared (MWIR, LWIR) or near infrared (NIR) wave band.Depending on vapor content and particle size, a thermal infrared imagermay significantly improve visibility under hazy conditions. If neitherthe visible nor the thermal imagers penetrate the haze, image capturingsystem 100A, 100B may be set in hazy conditions mode under which system100A, 100B attempts to extract what little information is available fromthe chosen infrared sensor. Under hazy conditions, there may be littlehigh spatial frequency information (e.g., mainly due, in one aspect, toscattering by particles). The information in the image may be obtainedfrom the low frequency part of the image, and boosting the higherfrequencies may drown the image in noise (e.g., temporal and/or fixedpattern).

Referring to FIG. 3E, a non-linear edge preserving low pass filter (LPF)is applied to the image (block 382). Next, the image is histogramequalized (block 384) and scaled (block 386) to form a histogramequalized output image. Next, the dynamic range of the output image islinearly mapped to fit the display component 140 (block 388). It shouldbe appreciated that the block order in which the process 380 is executedmay be executed in an different order without departing from the scopeof the present disclosure.

In various implementations, during processing of an image when the hazyconditions mode is selected, a non-linear, edge preserving, low passfilter, such as median or by anisotropic diffusion is applied to theimage (i.e., either from the thermal imager or the intensity componentof the visible color image). In one aspect, the output from the low passfilter operation may be histogram equalized and scaled to map thedynamic range to the display and to maximize contrast of the display.

FIG. 3F shows one embodiment of an infrared processing technique 390 asdescribed in reference to block 225 of FIG. 2. In one implementation,the infrared processing technique 390 comprises a shoreline mode ofoperation for maritime applications.

Referring to FIG. 3F, the shoreline may be resolved (block 392). Forexample as discussed previously, shoreline identification (e.g., horizonand/or shoreline) may be determined by applying an image processingtransform (e.g., a Hough transform) to the image (block 392), which maybe used to position the infrared camera's field of view and/or toprovide a line (e.g., any type of marker, such as a red line(s) or otherindicia on the displayed image. Next, the image is histogram equalized(block 394) and scaled (block 396) to form an output image. Next, thedynamic range of the output image is linearly mapped to fit the displaycomponent 140 (block 398). It should be appreciated that the block orderin which the process 390 is executed may be executed in a differentorder without departing from the scope of the present disclosure.

In one implementation, the information produced by the transform (e.g.,Hough transform) may be used to identify the shoreline or even thehorizon as a linear region for display. The transform may be applied tothe image in a path separate from the main video path (e.g., thetransform when applied does not alter the image data and does not affectthe later image processing operations), and the application of thetransform may be used to detect linear regions, such as straight lines(e.g., of the shoreline and/or horizon). In one aspect, by assuming theshoreline and/or horizon comprises a straight line stretching the entirewidth of the frame, the shoreline and/or horizon may be identified as apeak in the transform and may be used to maintain the field of view in aposition with reference to the shoreline and/or horizon. As such, theinput image (e.g., preprocessed image) may be histogram equalized (block394) and scaled (block 396) to generate an output image, and then thetransform information (block 392) may be added to the output image tohighlight the shoreline and/or horizon of the displayed image.

Moreover, in the shoreline mode of operation, the image may be dominatedby sea (i.e., lower part of image) and sky (i.e., upper part of image),which may appear as two peaks in the image histogram. In one aspect,significant contrast is desired over the narrow band of shoreline, and alow number (e.g., relatively based on the number of sensor pixels andthe number of bins used in the histogram) may be selected for theplateau limit for the histogram equalization. In one aspect, forexample, a low plateau limit (relative) may reduce the effect of peaksin the histogram and give less contrast to sea and sky while preservingcontrast for the shoreline and/or horizon regions.

FIG. 4 shows a block diagram illustrating a method 400 of implementingmodes 410A-410E and infrared processing techniques related thereto, asdescribed in reference to various embodiments of the present disclosure.In particular, a first mode refers to night docking mode 410A, a secondmode refers to man overboard mode 410B, a third mode refers to nightcruising mode 410C, a fourth mode refers to day cruising mode 410D, anda fifth mode refers to hazy conditions mode 410E.

In one implementation, referring to FIG. 4, processing component 110 ofimage capturing system 100A, 100B of FIGS. 1A, 1B may perform method 400as follows. Sensor data (i.e., infrared image data) of a captured imageis received or obtained (block 402). Correction terms are applied to thereceived sensor data (block 404), and temporal noise reduction isapplied to the received sensor data (block 406).

Next, at least one of the selected modes 410A-410E may be selected by auser or operator via control component 150 of image capturing system100A, 100B, and processing component 110 executes the correspondingprocessing technique associated with the selected mode of operation. Inone example, if night docking mode 410A is selected, then the sensordata may be histogram equalized and scaled (e.g., 0-511) (block 420),the sensor data may be linearly scaled (e.g., 0-128) saturating thehighest and lowest (e.g., 1%) (block 422), and the histogram equalizedsensor data is added to the linearly scaled sensor data for linearlymapping the dynamic range to display component 140 (block 424). Inanother example, if man overboard mode 410B is selected, then infraredcapturing component 130 of image capturing system 100A, 100B may bemoved or positioned so that the horizon is at an upper part of the fieldof view (FoV), a high pass filter (HPF) is applied to the sensor data(block 432), and the dynamic range of the high pass filtered sensor datais then linearly mapped to fit display component 140 (block 434). Inanother example, if night cruising mode 410C is selected, the sensordata is processed to extract a faint detailed part and a background partwith a high pass filter (block 440), the background part is histogramequalized and scaled (e.g., 0-450) (block 442), the detailed part isscaled (e.g., 0-511) (block 444), and the background part is added tothe detailed part for linearly mapping the dynamic range to displaycomponent 140 (block 446). In another example, if day cruising mode 410Dis selected, the sensor data is processed to extract a faint detailedpart and a background part with a high pass filter (block 450), thebackground part is histogram equalized and scaled (e.g., 0-511) (block452), the detailed part is scaled 0-255 (block 454), and the backgroundpart is added to the detailed part for linearly mapping the dynamicrange to display component 140 (block 456). In still another example, ifhazy condition mode 410E is selected, then a non-linear low pass filter(e.g., median) is applied to the sensor data (block 460), which is thenhistogram equalized and scaled for linearly mapping the dynamic range todisplay component 140 (block 462).

For any of the modes (e.g., blocks 410A-410E), the image data fordisplay may be marked (e.g., color coded, highlighted, or otherwiseidentified with indicia) to identify, for example, a suspected person inthe water (e.g., for man overboard) or a hazard in the water (e.g., fornight time cruising, day time cruising, or any of the other modes). Forexample, as discussed herein, image processing algorithms may be applied(block 470) to the image data to identify various features (e.g.,objects, such as a warm-bodied person, water hazard, horizon, orshoreline) in the image data and appropriately mark these features toassist in recognition and identification by a user viewing the display.As a specific example, a suspected person in the water may be coloredblue, while a water hazard (e.g., floating debris) may be colored yellowin the displayed image.

Furthermore for any of the modes (e.g., blocks 410A-410E), the imagedata for display may be marked to identify, for example, the shoreline(e.g., shoreline and/or horizon). For example, as discussed herein,image processing algorithms may be applied (block 475) to the image datato identify the shoreline and/or horizon and appropriately mark thesefeatures to assist in recognition and identification by a user viewingthe display. As a specific example, the horizon and/or shoreline may beoutlined or identified with red lines on the displayed image to aid theuser viewing the displayed image.

Next, after applying at least one of the infrared processing techniquesfor modes 410A-410E, a determination is made as to whether to displaythe processed sensor data in night mode (i.e., apply the night colorpalette) (block 480), in a manner as previously described. If yes, thenthe night color palette is applied to the processed sensor data (block482), and the processed sensor data is displayed in night mode (block484). If no, then the processed sensor data is displayed in a non-nightmode manner (e.g., black hot or white hot palette) (block 484). Itshould be appreciated that, in night mode, sensor data (i.e., imagedata) may be displayed in a red or green color palette to improve nightvision capacity for a user or operator.

FIG. 5 shows a block diagram illustrating one embodiment of controlcomponent 150 of infrared imaging system 100A, 100B for selectingbetween different modes of operation, as previously described inreference to FIGS. 2-4. In one embodiment, control component 150 ofinfrared imaging system 100A, 100B may comprise a user input and/orinterface device, such as control panel unit 500 (e.g., a wired orwireless handheld control unit) having one or more push buttons 510,520, 530, 540, 550, 560, 570 adapted to interface with a user andreceive user input control values and further adapted to generate andtransmit one or more input control signals to processing component 100A,100B. In various other embodiments, control panel unit 500 may comprisea slide bar, rotatable knob to select the desired mode, keyboard, etc.,without departing from the scope of the present disclosure.

In various implementations, a plurality of push buttons 510, 520, 530,540, 550, 560, 570 of control panel unit 500 may be utilized to selectbetween various modes of operation as previously described in referenceto FIGS. 2-4. In various implementations, processing component 110 maybe adapted to sense control input signals from control panel unit 500and respond to any sensed control input signals received from pushbuttons 510, 520, 530, 540, 550, 560, 570. Processing component 110 maybe further adapted to interpret the control input signals as values. Invarious other implementations, it should be appreciated that controlpanel unit 500 may be adapted to include one or more other push buttons(not shown) to provide various other control functions of infraredimaging system 100A, 100B, such as auto-focus, menu enable andselection, field of view (FoV), brightness, contrast, and/or variousother features. In another embodiment, control panel unit 500 maycomprise a single push button, which may be used to select each of themodes of operation 510, 520, 530, 540, 550, 560, 570.

In another embodiment, control panel unit 500 may be adapted to beintegrated as part of display component 140 to function as both a userinput device and a display device, such as, for example, a useractivated touch screen device adapted to receive input signals from auser touching different parts of the display screen. As such, the GUIinterface device may have one or more images of, for example, pushbuttons 510, 520, 530, 540, 550, 560, 570 adapted to interface with auser and receive user input control values via the touch screen ofdisplay component 140.

In one embodiment, referring to FIG. 5, a first push button 510 may beenabled to select the night docking mode of operation, a second pushbutton 520 may be enabled to select the man overboard mode of operation,a third push button 530 may be enabled to select the night cruising modeof operation, a fourth push button 540 may be enabled to select the daycruising mode of operation, a fifth push button 550 may be enabled toselect the hazy conditions mode of operation, a sixth push button 560may be enabled to select the shoreline mode of operation, and a seventhpush button 570 may be enabled to select or turn the night display mode(i.e., night color palette) off. In another embodiment, a single pushbutton for control panel unit 500 may be used to toggle to each of themodes of operation 510, 520, 530, 540, 550, 560, 570 without departingfrom the scope of the present disclosure.

FIG. 6 shows a block diagram illustrating an embodiment of image capturecomponent 130 of infrared imaging system 100A, 100B. As shown, imagecapture component 130 may be adapted to comprise a first cameracomponent 132, a second camera component 134, and/or a searchlightcomponent 136. In various implementations, each of the components 132,134, 136 may be integrated as part of image capture component 130 or oneor more of the components 132, 134, 136 may be separate from imagecapture component 130 without departing from the scope of the presentdisclosure.

In one embodiment, first camera component 132 may comprise an infraredcamera component capable of capturing infrared image data of image 170.In general, an infrared camera is a device that is adapted to form animage using infrared radiation, which may be useful for rescueoperations in water and/or darkness.

In one embodiment, second camera component 134 may comprise anotherinfrared camera component or a camera capable of capturing visiblespectrum images of image 170. In general, a visible-wavelength cameramay be used by a crew member of watercraft 180 to view and examine theimage 170. For example, in daylight, the visible-wavelength camera mayassist with viewing, identifying, and locating a man overboard.

In various implementations, the camera components 132, 134 may beadapted to include a wide and/or narrow field of view (e.g., a fixed orvariable field of view). For example, this feature may include atelescoping lens that narrows the field of view to focus on a particulararea within the field of view.

In one embodiment, searchlight component 136 comprises a device capableof projecting a beam of light towards image 170 in the field of view. Inone implementation, searchlight component 136 is adapted to focus a beamof light on a target within the field of view of at least one of cameracomponents 132, 134 so as to identify and locate, for example, aposition of a man overboard, which would allow a crew member ofwatercraft 180 to have improved visibility of the man overboard indarkness.

FIG. 7 shows a block diagram illustrating an embodiment of a method 700for monitoring image data of infrared imaging system 100A, 100B. In oneimplementation, method 700 is performed by processing component 110 ofinfrared imaging system 100A, 100B. As shown in FIG. 7, image data isobtained (block 710). In various implementations, the image data may beobtained directly from the image capture component 130 or from storagein memory component 120.

Next, the obtained image data may be processed (block 714). In oneimplementation, the obtained image data may be processed using the manoverboard mode of operation 320 of FIG. 3B to collect image data todetect an object, such as a person, falling into or in the waterproximate to watercraft 180.

Next, a man overboard (e.g., person) may be identified from theprocessed image data (block 718). In one implementation, the object(e.g., a person) may be separated from the water based on thetemperature difference therebetween. For example, when a person having abody temperature of approximately 98 degrees falls into the water havinga water temperature of approximately 60-70 degrees or less, thedifference between the temperatures is viewable with an infrared image,and therefore, the person may be quickly identified and located in thewater.

In an example embodiment, various types of conventional image processingsoftware (e.g., a software package by ObjectVideo located in Reston,Va.) may be run by processing component 110 to perform image analysis tomonitor the image data and detect a man overboard condition. In anexample embodiment, features in such conventional software may supportthe use of threshold conditions or object discrimination, for example,to distinguish non-living objects, such as a deck chair or otherinanimate objects, from a person. Programming the software package withthreshold factors such as temperature, shape, size, aspect ratio,velocity, or other factors may assist a software package indiscriminating images of non-living and/or non-human objects from imagesof humans. Thus, threshold conditions for use as desired in a givenapplication may provide that a bird flying through a camera's field ofview, for example, may be ignored, as would a falling deck chair or cupof hot coffee thrown overboard.

When a man overboard condition is suspected or determined, an operator(e.g., crew member) may be alerted or notified (block 722) so that arescue action may be initiated. In various implementations, this alertor notification may comprise an audio signal and/or visual signal, suchas an alarm, a warning light, a siren, a bell, a buzzer, etc.

Next, the specific location of the man overboard may be identified basedon the image data (block 726). In one implementation, identifying thelocation of the person may include narrowing the field of view of theimage capture component 130. For example, a lens of the infrared cameramay telescope to a position to zoom-in on the object or person in thewater or zoom-in on at least the proximate location of the person in thewater or another narrower field of view image capture component 130 maybe directed to the proximate location of the person in the water.Furthermore, a searchlight (e.g., searchlight component 136 of the imagecapture component 130) may be directed to the proximate location of theperson in the water (block 730) to assist with the retrieval and rescueof the person overboard.

When a man overboard condition is detected, for example in accordancewith an embodiment, the time and/or location of the event may berecorded along with the image data (e.g., as part of block 722 or 726),such as to aid in the search and rescue operation and/or to provideinformation for later analysis of the suspected man overboard event.Alternatively, the time and/or location may be regularly recorded withthe image data. For example, processing component 110 (FIGS. 1 a, 1 b)may include a location determination function (e.g., a globalpositioning system (GPS) receiver or by other conventional locationdetermination techniques) to receive precise location and/or timeinformation, which may be stored (e.g., in memory component 120) alongwith the image data. The image data along with the location informationand/or time information may then be used, for example, to allow a searchand rescue crew to leave the ship (e.g., cruise ship) and backtrack in asmaller vessel or helicopter to the exact location of the man overboardcondition in a prompt fashion as a large ship generally would not beable to quickly stop and return to the location of the man overboardevent.

Where applicable, various embodiments of the invention may beimplemented using hardware, software, or various combinations ofhardware and software. Where applicable, various hardware componentsand/or software components set forth herein may be combined intocomposite components comprising software, hardware, and/or both withoutdeparting from the scope and functionality of the present disclosure.Where applicable, various hardware components and/or software componentsset forth herein may be separated into subcomponents having software,hardware, and/or both without departing from the scope and functionalityof the present disclosure. Where applicable, it is contemplated thatsoftware components may be implemented as hardware components andvice-versa.

Software, in accordance with the present disclosure, such as programcode and/or data, may be stored on one or more computer readablemediums. It is also contemplated that software identified herein may beimplemented using one or more general purpose or specific purposecomputers and/or computer systems, networked and/or otherwise. Whereapplicable, ordering of various steps described herein may be changed,combined into composite steps, and/or separated into sub-steps toprovide features described herein.

In various embodiments, software for mode modules 112A-112N may beembedded (i.e., hard-coded) in processing component 110 or stored onmemory component 120 for access and execution by processing component110. As previously described, the code (i.e., software and/or hardware)for mode modules 112A-112N define, in one embodiment, preset displayfunctions that allow processing component 100A, 100B to switch betweenthe one or more processing techniques, as described in reference toFIGS. 2-4, for displaying captured and/or processed infrared images ondisplay component 140.

Referring now to FIGS. 8-13, a system for aiming multiple opticaldevices, such as night vision devices and/or cameras, at a common targetis discussed, according to various embodiments. For example, accordingto one embodiment, a more powerful (e.g., having greater magnificationand/or greater sensitivity, for example), fixed night vision camerasystem may be aimed at a man overboard once the man overboard has beenspotted with a less powerful (e.g., having less magnification and/orless sensitivity, for example), handheld night vision device. Also forone or more embodiments, the imaging devices may represent one or moreinfrared and/or visible cameras (e.g., fixed, fixable, and/or portablecameras) that may be in (or capable of) wireless communication and forma wireless camera system that provides slew-to-cue functionality (asdiscussed herein) between the cameras to provide information to allowone or more cameras to direct their field of view to an area of interestdesignated by one or more of the other cameras in the system.Furthermore for one or more embodiments, the cameras and techniquesdisclosed herein may be applied to land, marine, air, and/or spaceenvironments and may include user interfaces that allow a user to storethe designated information (e.g., location, line of sight, pointingdirection, compass, heading, and/or other information), selectivelyprovide the information to other cameras in the system, and/or acceptthe provided information such that the camera for an associated user isdirected to point to the area of interest corresponding to the receivedinformation from another camera in the system.

FIG. 8 shows a block diagram illustrating an imaging system 800 foraiming a fixed mount camera subsystem 801 at a target 803 being observedwith a portable imaging/viewing subsystem 802. The portableimaging/viewing subsystem 802 may be held by a user 807 and in one ormore embodiments portable imaging/viewing subsystem 802 may represent afixed mount (or fixable mount) and similarly for some embodiments fixedmount camera subsystem 801 may represent a portable imaging/viewingsubsystem.

The imaging system 800 may be implemented upon a watercraft 804, forexample. When implemented upon a watercraft 804, the target 803 may be aman overboard, for example. Thus, the imaging system 800 may be usefulin search and rescue operations, such as when a person falls off of aship at sea.

The fixed mount camera subsystem 801 may have a field of view 811. Theportable imaging/viewing subsystem 802 may have a field of view 812.Generally, the field of view 811 may at least partially overlap with thefield of view 812, such that the target 803 may be imaged and/or viewedby both the fixed mount camera subsystem 801 and the portableimaging/viewing subsystem 802. Thus, once the user 807 locates thetarget 803 with the portable imaging/viewing subsystem 802, then theuser 807 may signal the fixed mount camera subsystem 801 to view thetarget 803, as well, and provide the required information to point tothe area of interest.

The fixed mount camera subsystem 801 may have capabilities that areabsent in the portable imaging/viewing subsystem 802. For example, fixedmount camera subsystem 801 may have multiple cameras, may have camerasof multiple focal lengths (magnifications), may have cameras that aresensitive to multiple wavelengths of light (such as visible light,infrared light, and/or ultraviolet light), may automatically track thetarget 803, and/or may relay information about the target to a remotelocation (such as off of the watercraft 804). The size and/or weight ofthe fixed mount camera subsystem 801 may be substantially greater thanthe size and/or weight of the portable imaging/viewing subsystem 802. Itmay be substantially advantageous to have the fixed mount camerasubsystem 801 view the target instead of the portable imaging/viewingsubsystem 802 or in addition to the portable imaging/viewing subsystem802.

The fixed mount camera subsystem 801 may be permanently attached to thewatercraft 804. The fixed mount camera subsystem 801 may be remotelyoperated by a person or may be operated by an automated system. Forexample, the fixed mount camera subsystem 801 may be an M-Series camerasystem, manufactured by FLIR Systems™ of Wilsonville, Oreg.

The portable imaging/viewing subsystem 802 may be hand held, tripodmounted, or otherwise maintained in position. The portableimaging/viewing subsystem 802 may be manually operated by a collocateduser. For example, the portable imaging/viewing subsystem 802 may be anH-Series thermal camera, manufactured by FLIR Systems™.

The imaging system 800 may comprise a communications link 810 that isconfigured to communicate a signal from the portable imaging/viewingsubsystem 802 to the fixed mount camera subsystem 801. Thecommunications link 810 may be a wired communications link or a wirelesscommunications link, with examples such as a cellular telephonecommunications link, an optical communications link, a networkcommunications link, a Bluetooth™ communications link, and/or a Wi-Fi™communications link. The communications link 810 may be any type ofcommunications link. The communications link 810 may be any combinationof communications links that operate serially and/or in parallel withrespect to one another.

FIG. 9 shows a display 900 that may be viewed by the user 807 of theportable imaging/viewing subsystem 802, in accordance with an embodimentof the present disclosure. The display 900 may comprise a real timerepresentation of a scene 901 being imaged and/or viewed via theportable imaging/viewing subsystem 802. The scene 901 may be providedoptically, with or without electronic processing. Thus, the scene 901may be a video display similar to that of a camcorder and/or may be anoptical display like that of a telescope or binoculars.

The display 900 may comprise a heading indication 902 and/or a rangeindication 903. The heading indication 902 may be a heading tape, forexample. The heading indication 902 may be an alpha-numeric indication.The heading indication 902 may be any type of indication. The rangeindication 903 may be a range tape, an alpha-numeric indication, and/orany other form of range indication.

Target designation indicia 904 may be provided on the display 900 tofacilitate the designation of the target 803 for which a heading andrange are desired. The target designation indicia 904 may be a window(such as a square, rectangular, oval, or round window), a set orcross-hairs (as shown in FIG. 9), or any other type of indicia. Movingthe portable imaging/viewing subsystem 802 so as to place the targetunder or within the target designation indicia 904 may facilitatedetermination of the heading and range to the target with respect to theportable imaging/viewing subsystem 802.

FIG. 10 shows a block diagram illustrating a portable imaging/viewingsubsystem 802, in accordance with an embodiment of the presentdisclosure. The portable imaging/viewing subsystem 802 may include animaging device, such as a camera (a still camera and/or a video camera,for example), and may include a viewing device, such as a telescope orbinoculars. The camera may be a visible light camera, an infrared cameraor any other type of camera. The portable imaging/viewing subsystem 802may include a plurality of cameras of any type or combination of types(e.g., as discuss in reference to FIG. 6). The portable imaging/viewingsubsystem 802 may represent an infrared camera and additionally mayinclude a position finder and at least a portion of the communicationlink 810.

For example, the portable imaging/viewing subsystem 802 may compriseoptics 1001 configured to receive light in from a scene (such as a manoverboard in the ocean) and to provide light out to facilitate viewingby the user 807. The light out may be magnified, intensified, filtered(such as polarization and/or spectrally filtered), and/or otherwiseoptically and/or electronically processed. For example, the optics 1001may comprise a telescope or a pair of binoculars.

According to an embodiment, the imaging/viewing subsystem 802 maycomprise a camera, such as a video camera. For example, a video cameramay be defined by an imager 1002, a controller 1004, and a display 1005.The portable imaging/viewing subsystem 802 may facilitate viewing withthe optics 1001 only (e.g., without a video camera, such as by viewingthe light out), with a video camera only (e.g., via the display 1005),or with both the optics 1001 and the video camera. The optics 1001 maybe used by the video camera (such as for focus, zoom, imagestabilization, and/or filtering) or may be used only for optical (notcamera) viewing. Thus, the video camera may use the optics 1001 thatalso facilitate optical viewing and/or may use separate, dedicatedoptics.

The imager 1002 may receive light from the optics 1001 via a beamsplitter 1003 or the like. The imager 1002 may provide a signalrepresentative of video images to the controller 1004. The controller1004 may, among other things, process the video images for viewing uponthe display 1005. The controller 1004 may, for example, comprise amicroprocessor 1006 and may thus be a microprocessor based controller orother type of logic device (e.g., processor, programmable logic device,and/or application specific integrated circuit).

The portable imaging/viewing subsystem 802 may comprise a portion of thecommunications link 810 (FIG. 8). The portable imaging/viewing subsystem802 may comprise a transmitter or transceiver (xcvr) 1007 that isconfigured to transmit information regarding the target 803 to the fixedmount camera subsystem 801. For example, the transceiver 1007 maytransmit position information such as a position of the portableimaging/viewing subsystem 802, as well as a heading and a range to thetarget 803. As a further example, the transceiver 1007 may transmit theposition of the target 803. As yet further examples, the transceiver1007 may transmit the scene 901 (FIG. 9), voice, data, control signals,and/or any other information and similarly receive from other devicessimilar information. The transceiver 1007 may for some embodimentsrepresent any type of communication interface to provide or receiveinformation from another device (e.g., establish a communication linkwith the fixed mount camera subsystem 801.

The transceiver 1007 may transmit in response to the user 807 actuatinga control of the portable imaging/viewing subsystem 802. For example,the scene 901 may be transmitted in response to the user 807 depressinga button 1008, a display touch screen selection, or other controlcomponent (e.g., as discussed in reference to FIGS. 1A and 5). Forexample, button 1008 may represent one or more user interface controls,which may be selected to perform various functions (e.g., slew-to-cue orother functionality), such as provide position information to a remotedevice to assist in locating the target of interest or request pointingcues to be displayed to assist a user in pointing in the direction of atarget based on target position information received, as discussedfurther herein.

Actuating the control, e.g., depressing the button 1008, may also causeinformation to be stored, such as in a memory 1009 of the portableimaging/viewing subsystem 802. The information may include positioninformation such as the position of the portable imaging/viewingsubsystem 802, as well as heading and range to the target 803, and/orposition of the target 803. The memory 1009 may store this information,including the position of the target 803, the position of the portableimaging/viewing subsystem 802, heading and range to the target 803, thescene 901, voice, data, control signals, and/or any other information.

The position of the target 803 may be determined by a position finderdefined by a GPS (global positioning system receiver) 1011, a rangefinder 1013, and a digital compass 1012. The controller 1004 may useinformation from the GPS 1011, the range finder 1013, and the digitalcompass 1012 to determine the position of the target 803. Alternatively,a remote device, such as a remote computer and/or the fixed mount camerasubsystem 801 may use information from the GPS 1011, the range finder1013 (e.g., laser rangefinder), and the digital compass 1012 (e.g., anytype of compass) to determine the position of the target 803.

The position of the target 803 may be determined from the position ofthe portable imaging/viewing subsystem 802, the heading to the target803 with respect to the portable imaging/viewing subsystem 802, and therange to the target 803 from the portable imaging/viewing subsystem 802.The position of the portable imaging/viewing subsystem 802 may bedetermined with the GPS 1011. The heading of the target 803 with respectto the portable imaging/viewing subsystem 802 may be determined using adigital compass 1012. The range to the target 803 from the portableimaging/viewing subsystem 802 may be determined using the rangefinder1013. Thus, the digital compass 1012 and the rangefinder 1013 maycooperate to define a target position finder. Various types ofrangefinders are suitable. For example, the rangefinder 1013 may be alaser rangefinder, an ultrasonic range finder, or an opticalrangefinder.

The signal transmitted by the transceiver 1007 may be used by devicesother than the fixed mount camera subsystem 801. For example, theposition of the target 803 may be transmitted by the transceiver 1007 tosearch and rescue personnel in an aircraft or may be transmitted by thetransceiver 1007 to another watercraft.

The controller 1004 may use instructions stored in the memory 1009and/or may be configured (e.g., hard wired or programmed) to performvarious tasks, such as determination of the location of the target 803,operation of the transceiver 1007, processing of the images from imager1002, operation of the display 1005, and/or monitoring of a state of thebutton 1008. The controller 1004 may be a general purpose computer, anapplication specific computer, or any other type of controller orprocessor.

In accordance with an embodiment, the portable imaging/viewing subsystem802 may be implemented as discussed in reference to FIG. 1A. For examplefor an embodiment, the portable imaging/viewing subsystem 802 mayrepresent an infrared camera or other device configured as infraredimaging system 100A (FIG. 1A) or infrared imaging system 100B (FIG. 1B),with sensing component 160 (FIGS. 1A, 1B) including and representing thevarious wireless functionality and position finder features (discussedin reference to FIGS. 8-10), such as transceiver 1007, GPS 1011, compass1012, and/or rangefinder 1013. Furthermore, the various elements of FIG.10 may correspond to various elements described herein, such as inreference to FIGS. 1A, 1B, 5, and 6. For example for an embodiment,imager 1002, controller 1004, display 1005, memory 1009, and button 1008may be implemented as discussed for image capture component 130,processing component 110, display component 140, memory component 120and/or mode modules 112A-112N, and control component 150, respectively.

FIG. 11 shows a block diagram illustrating the fixed mount camerasubsystem 801, in accordance with an embodiment of the presentdisclosure. The fixed mount camera subsystem 801 may be permanently orsemi-permanently mounted, such as to the watercraft 804 (FIG. 1). Thefixed mount camera subsystem 801 may be mounted to any desired vehicleor platform. For example, the fixed mount camera subsystem 801 may bemounted to a land based vehicle, a ship, a submarine, an aircraft, aspacecraft, or a satellite. The fixed mount camera subsystem 801 may bemounted to a non-vehicle structure or to the earth. For example, thefixed mount camera subsystem 801 may be mounted to a life guard stationor may be autonomously mounted along a beach, pier, or waterfront.

A plurality of fixed mount camera subsystems 801 and/or a plurality ofthe portable imaging/viewing subsystems 802 may be included in theimaging system 800 (e.g., as configured and discussed in reference toFIG. 1C). Thus, one or more of the portable imaging/viewing subsystems802 may communicate with one or more of the fixed mount camerasubsystems 801 and/or one or more of the portable imaging/viewingsubsystems 802 to communicate object position information to image acommon target 803 (e.g., slew-to-cue techniques). As an exampleembodiment, the fixed mount camera subsystem 801 may be implemented asdiscussed in reference to FIGS. 1B-1F.

As an example, a plurality of portable imaging/viewing subsystems 802may be included in the imaging system 800. Thus, the portableimaging/viewing subsystems 802 may communicate with one or more of thefixed mount camera subsystems 801 and in response the one or more fixedmount camera subsystems 801 may image a common target 803.

One portable imaging/viewing subsystem 802 may image and/or transmit theposition of a plurality of separate targets 803. The portableimaging/viewing subsystem 802 may store the location of the plurality ofseparate targets 803.

Thus, the practice of various embodiments may involve multiple portableimaging/viewing subsystems 802, multiple fixed mount camera subsystems801, and/or multiple targets 803. The imaging system 800 may accommodateany number of portable imaging/viewing subsystems 802 and fixed mountcamera subsystems 801, which cooperate with one another, to identify andview/image one or more targets 803.

The fixed mount camera subsystem 801 may comprise a camera 1101 andcamera positioner, e.g., a pan and tilt mount 1102. The pan and tiltmount 1102 may drive or aim the camera 1101 in a desired direction, suchas toward the target 803. The fixed mount camera subsystem 801 maycomprise any number of cameras 1101 that are driven by any number of panand tilt mounts 1102. For example, the fixed mount camera subsystem 801may comprise a wide angle visible light camera, a telephoto visiblelight camera, and/or an infrared camera that are all driven by a commonpan and tilt mount 1102. Alternatively, the fixed mount camera subsystem801 may comprise a wide angle visible light camera, a telephoto visiblelight camera, and/or an infrared camera that are each driven by separatepan and tilt mounts 1102.

The camera 1101 may comprise optics 1103 that provide light to an imager1104. The imager 1104 may provide a video output to controller 1106. Thecontroller 1106 may have a microprocessor 1107 and may thus be amicroprocessor based controller or other type of logic device (e.g.,processor, programmable logic device, and/or application specificintegrated circuit).

The controller 1106 may receive information from a transceiver (xcvr)1108. For example, the controller 1106 may receive informationrepresentative of the position of the target 803 from the transceiver1108 after this information was communicated from the portableimaging/viewing subsystem 802 to the fixed mount camera subsystem 801.The transceiver 1108 may receive voice, data, control signals, and/orany other information and may provide such information to the controller1106. The transceiver 1108 may transmit any type of information, such asvoice, data, control signals, and/or any other information to theportable imaging/viewing subsystem 802. For example, the transceiver1108 may transmit a close up (magnified) and polarization filtered (toreduce glare) image of the target 803 to the portable imaging/viewingsubsystem 802. The transceiver 1108 may for some embodiments representany type of communication interface to provide or receive informationfrom another device (e.g., establish a communication link with theportable imaging/viewing subsystem 802.

The pan and tilt mount 1102 may comprise a drive motor controller 1109.The drive motor controller 1109 may use position feedback to determinewhere the camera 1101 is being aimed. For example, position feedbacksensors may be provided on gimbals (not shown) of the pan and tilt mount1102. The drive motor controller 1109 may provide drive signals to a panmotor and a tilt motor.

The position of the target 803, video images, or any other informationmay be stored in a memory 1112. The position of the target 803 may beindicated on a chart, such as by being plotted on a chart plotter (notshown) in a wheelhouse of the watercraft 804.

The controller 1106 may use instructions stored in the memory 1112and/or may be configured (e.g., hard wired or programmed) to performvarious tasks, such as determination of the location of the target 803,operation of the transceiver 1108, operation of the pan and tilt mount1102 via the drive motor controller 1109, and/or tracking of the target803. The controller 1106 may be a general purpose computer, anapplication specific computer, or any other type of controller orprocessor.

In accordance with an embodiment, the fixed mount camera subsystem 801may be implemented as discussed in reference to FIGS. 1A-1F, 5, and 6and implement various techniques as discussed in reference to FIGS. 2-4and 7. For example for an embodiment, the fixed mount camera subsystem801 may represent an infrared camera or other device configured asinfrared imaging system 100A (FIG. 1A) or infrared imaging system 100B(FIG. 1B), with sensing component 160 (FIGS. 1A, 1B) including andrepresenting the various wireless functionality and object positionfinder features (discussed in reference to FIGS. 8-10), such astransceiver 1007, GPS 1011, compass 1012, and/or rangefinder 1013.

Furthermore, the various elements of FIG. 11 may correspond to variouselements described herein, such as in reference to FIGS. 1A, 1B, 5, and6. For example for an embodiment, imager 1104, controller 1106, andmemory 1112 may be implemented as discussed for image capture component130, processing component 110, and memory component 120 and/or modemodules 112A-112N, respectively. For some embodiments, the portableimaging/viewing subsystem 802 (FIG. 10) may include pan/tilt mount 1102,as discussed in reference to FIG. 11, to provide a pointing mechanism.Additionally for some embodiments, the fixed mount camera subsystem 801may be implemented with certain functionality as described for theportable imaging/viewing subsystem 802, such as for example the fixedmount camera subsystem 801 may include object (or target) positionfinder functionality that may include GPS, rangefinder, and/or compassfunctionality such that this information may be wirelessly provided toother cameras in the vicinity (e.g., to the portable imaging/viewingsubsystem 802).

FIG. 12 shows a flow chart illustrating a method for aiming the camera1101 of the fixed mount camera subsystem 801 at the target 803 beingobserved using the portable imaging/viewing subsystem 802, in accordancewith an embodiment of the present disclosure. The target 803 may beimaged or viewed with the portable imaging/viewing subsystem 802 (block1201). A position of the target 803 may be determined using a targetposition finder of the portable imaging/viewing subsystem 802 (block1202). The target position finder may include the GPS 1011, the digitalcompass 1012, and the rangefinder 1013, as discussed herein.

The position of the target 803 may be communicated from the portableimaging/viewing subsystem 802 to the fixed mount camera subsystem 801(block 1203), such a via the communications link 810. The fixed mountcamera 1101 may be aimed toward the target 803 (block 1204), so as tofacilitate imaging and/or viewing of the target 803 via the fixed mountcamera 1101.

It should be understood that the method disclosed in FIG. 12 may beapplied to any and between any imaging/viewing devices (e.g., fixedmount camera subsystem 801 or portable imaging/viewing subsystem 802) asdisclosed herein. For example, the method may be applied such that thefixed mount camera subsystem 801 may communicate the target position tothe portable imaging/viewing subsystem 802 such that the portableimaging/viewing subsystem 802 may be pointed to the object of interest.As a further example for one or more embodiments, the portableimaging/viewing subsystem 802 may provide pointing cues to a user of theportable imaging/viewing subsystem 802 to assist a user in pointing theportable imaging/viewing subsystem 802 to the object of interest basedon the information provided by another device (e.g., the fixed mountcamera subsystem 801). For example, the desired heading and range may bedisplayed for a user to view and adjust the pointing direction of theportable imaging/viewing subsystem 802, with the heading adjusted, aswould be understood by one skilled in the art, based upon positiondifference between the portable imaging/viewing subsystem 802 and thedevice providing the information. Alternatively as an example, pointingcues (e.g., left, right, up, down arrows) may be provided on a displayto guide a user in pointing in the desired direction based on theinformation provided by the other device.

FIG. 13 shows a flow chart illustrating a method for determining aposition of the target 803 with respect to the portable imaging/viewingsubsystem 802, in accordance with an embodiment of the presentdisclosure. A position of the portable imaging/viewing subsystem 802 maybe determined (block 1301). The position of the portable imaging/viewingsubsystem 802 may be determined using the GPS 1011, for example.Alternatively, the position of the portable imaging/viewing subsystem802 may be determined using another method, such as triangulation, forexample. According to an embodiment, the position of the portableimaging/viewing subsystem 802 may be fixed (such as when the portableimaging/view subsystem 802 is installed at a lifeguard station) and thusmay be predetermined.

The heading and range to the target 803 may be determined with respectto the portable imaging/viewing subsystem 802 (block 1302). The headingmay be determined using the digital compass 1012 and the range may bedetermined using the range finder 1013. The position of the target 803may then be determined from the position of the portable imaging/viewingsubsystem 802, the heading, and the range to the target 803 (block1303), as would be understood by one skilled in the art. It should alsobe understood that the method of FIG. 13 may also be implemented for thefixed mount camera subsystem 801 given the position finderfunctionality, as discussed herein.

Thus, according to an embodiment, a more powerful, fixed night visioncamera system may be aimed at a man overboard once the man overboard hasbeen spotted with a less powerful, handheld night vision device. The useof the more powerful, fixed night vision camera may substantiallyenhance the likelihood of a successful rescue of the man overboard.

Various embodiments may be used to spot and/or identify pirates orterrorists. In addition to or in place of the cameras of the fixed mountcamera subsystem 801, other devices may be aimed. Lethal and/ornon-lethal weapons may be aimed, such as at a potential enemy orintruder. For example, sonic non-lethal weapons, microwave non-lethalweapons, water cannons, etc. may be aimed at a potential enemy orintruder. As further examples, machine guns, cannons, and or missilesmay be aimed at a potential enemy or intruder.

As used herein, the term “heading” may be defined to include the anglebetween a line of sight from the portable imaging/viewing subsystem 802to the target 803 and a reference such a true north or the bow of theship. As used herein, the term “heading” may be defined to be adirection from the portable imaging/viewing subsystem 802 to the target803 and may be the same as the bearing of the target 803 with respect tothe portable imaging/viewing subsystem 802.

In accordance with one or more embodiments, the techniques disclosedherein may be applied to various types of application, as noted herein,in addition to the maritime applications. For example, the techniquesdisclosed herein may be applied to land, air, or space applications,where target location and pointing information (e.g., slew-to-cue)information may be useful.

In accordance with one or more embodiments, the fixed mount camerasubsystem 801 and the portable imaging/viewing subsystem 802 mayimplement various mode functionality as discussed herein (e.g., inreference to FIGS. 1A-7) and may be implemented within a system toperform various techniques, as discussed herein (e.g., in reference toFIGS. 1A-7 and/or FIGS. 8-13). For example, a system (e.g., as discussedin reference to FIG. 1C or 8) may be implemented with (or made up of)various devices, including one or more of the fixed mount camerasubsystem 801 and one or more of the portable imaging/viewing subsystem802, with one or more of or each of the devices user operable to selectvarious maritime modes (e.g., as discussed in reference to FIGS. 2, 4,and 5).

One or more of the devices may also be user operable to provide objectposition information (e.g., automatically or by user command via a userinterface as discussed herein, such as in reference to FIGS. 1A, 5, and8-13) to other devices within the system. One or more of the devices mayfurther be user operable to receive object position information fromother devices and automatically or by user acceptance (e.g., by usercommand via the user interface) allow the device to point to thedesignated object of interest or provide pointing cues (e.g., via thedisplay) to guide the user to point the device to the designatedlocation of the object based on the received object positioninformation.

As an example for an embodiment, a user viewing an object of interestmay command via the user interface to store object location informationand/or provide the object location information to other devices withinthe system, which may then (or upon a corresponding user's acceptancevia a corresponding user interface) slew to point at the object based onthe object location information received. For example, the devices forone or more embodiments may provide on-screen graphics for slew-to-cuefunctionality (e.g., look where I am looking functionality). Therefore,the slew-to-cue techniques disclosed herein may provide certainadvantages within a camera system architecture, as disclosed herein.

Embodiments described above illustrate but do not limit the disclosure.It should also be understood that numerous modifications and variationsare possible in accordance with the principles of the presentdisclosure. Accordingly, the scope of the disclosure is defined only bythe following claims.

What is claimed is:
 1. A system, comprising: a fixed mount camerasubsystem having a camera, a camera positioner, and a firstcommunications interface; a portable imaging/viewing subsystem having atarget position finder and a second communications interface adapted toestablish a communications link with the first communications interfaceto communicate a signal from the target position finder to the camerapositioner, the signal being representative of position information of atarget being imaged/viewed with the portable imaging/viewing subsystem;and wherein the fixed mount camera subsystem is configured to aim thecamera using the camera positioner toward the target in response to thesignal.